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ABSTRACT 



A method of generating an output array of image spatial 
frequency coefficients from input arrays of image spatial 
frequency coefficients overlapped by the required array, the 
spatial frequency coefficients being transformable to image 
pixel values by a predetermined spatial frequency 
transformation, comprises the steps of: matrix-multiplying 
each input array by one or more respective matrices having 
coefficients derivable by applying the inverse of the prede- 
termined spatial frequency transformation to respective 
translation matrices which, if matrix-multiplied by that input 
array, would provide a translation of the overlapped portion 
of that input array to an overlapping position in the output 
array; and matrix-adding the respective matrix products 
generated from each overlapped input array. 

5 Claims, 6 Drawing Sheets 
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SPATIAL FREQUENCY-DOMAIN VIDEO 
SIGNAL PROCESSING 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to frequency-domain signal 
processing, and particularly to video signal processing in the 
spatial frequency domain. 

2. Description of the Prior Art 

Motion estimation is used in many video signal process- 
ing schemes, and in particular video compression schemes, 
in order to reduce the amount of data which has to be 
transmitted or stored to represent a series of images (e.g. 
fields or frames). This benefit can be achieved because there 
is often a great deal of redundancy present in a video 
sequence. In particular, many areas of an image stay the 
same or are simply displaced from image to image. Thus, a 
reasonably good replica of a frame can be constructed from 
appropriately selected areas of previous frame(s), referred to 
here as reference frames. 

For this type of processing, frames are generally broken 
down into square or rectangular areas (arrays of pixels) 
known as macroblocks. For example, in one previously 
proposed system, a macroblock comprises an array of 16x16 
pixels. For each macroblock, one or more motion vectors is 
computed and transmitted or stored. The motion vectors 
point to areas on previous frame(s) which most closely 
resemble the content of the macroblock. 

At the decoder, the motion vectors, together with error 
data (representing the difference between the actual or 
original frame and a replica predicted from the reference 
frame(s) using the motion vectors) are used to reconstruct 
each frame. 

The process of computing the motion vectors at the 
encoder is generally referred to as motion estimation, and 
the process of generating the replica or reconstructed frames 
is generally referred to as motion compensation. 

Many video compression schemes which use motion- 
based processing also try to reduce further the redundancy 
present in the video data, by first transforming the spatial 
domain data into a corresponding set of frequency domain 
coefficients which represent different spatial frequency com- 
ponents of the video data, and then reducing the amount of 
information by quantising these coefficients. A common 
technique for transforming the data to and from the fre- 
quency domain is the discrete cosine transform (DCT). 

The discrete cosine transform is a block-based, process, 
so that an array of DCT coefficients is generated from each 
macroblock, independently of other macroblocks in the 
image. Usually, the array of coefficients (referred to here as 
a DCT block) is the same size (i.e. the same number of 
elements) as the original macroblock. 
T> Therefore, if there is a need to generate a block of DCT 
coefficients based on a different block structure, it is neces- 
sary to decode the DCT data back to spatial (pixel) data and 
\ then recede in accordance with the required block structure, 
L This can be processor-intensive and time-consuming. 

^ SUMMARY OF THE INVENTION 

This invention provides a method of generating an output 
array of image spatial frequency coefficients from input 
arrays of image spatial frequency coefficients overlapped by 
the required array, the spatial frequency coefficients being 
transformable to image pixel values by a predetermined 
spatial frequency transformation, the method comprising the 
. steps of: 



matrix-multiplying each input array by one or more 
respective matrices having coefficients derivable by apply- 
ing the inverse of the predetermined spatial frequency 
transformation to respective translation matrices which, if 

5 matrix-multiplied by that input array, would provide a 
translation of the overlapped portion of that input array to an 
overlapping position in the output array; and 

matrix-adding the respective matrix products generated 
from each overlapped input array. 

10 The invention involves a recognition of the counter- 
intuitive feature of spatial frequency coefficients such as 
DCT coefficients, that a required array overlapping a number 
of input arrays of coefficients can be generated simply by 
matrix-multiplying each input array which is overlapped by 

15 an array position in the output array by suitable pre- and 
post-matrices. 

This now means that motion compensation can be per- 
formed in the DCT domain. This is potentially very useful 
20 in applications such as, for example, converting one GOP 
format into another GOP format. 

Preferably the predetermined spatial frequency transfor- 
mation is the inverse discrete cosine transform. 

For use in motion compensation techniques, it, is pre- 
25 ferred that the method comprises the step of detecting 
portions of the input arrays overlapped by the output array 
in response to a motion vector associated with the output 
array. 

Preferably the one or more matrices comprise a pre- 
30 multiplying matrix and a post-multiplying matrix. 

The invention also provides video signal processing appa- 
ratus for generating an output array of image spatial fre- 
quency coefficients from input arrays of image spatial fre- 
quency coefficients overlapped by the required array, the 
spatial frequency coefficients being transformable to image 
pixel values by a predetermined spatial frequency 
transformation, the apparatus comprising: 

means for matrix-multiplying each input array by one or 
more respective matrices having coefficients derivable 
by applying the inverse of the predetermined spatial 
frequency transformation to respective translation 
matrices which, if matrix-multiplied by that input array, 
would provide a translation of the overlapped portion 
of that input array to an overlapping position in the 
output array; and 
means for matrix-adding the respective matrix products 
generated from each overlapped input array. 



35 



40 



50 



BRIEF DESCRIPTION OF THE DRAWINGS 



The above and other objects, features and advantages of 
the invention will be apparent from the following detailed 
description of illustrative embodiments which is to be read 
in connection with the accompanying drawings, in which: 
55 FIG. 1 is a schematic diagram of a previously proposed 
video data compression apparatus; 

FIG. 2 is a schematic diagram of a complementary 
previously proposed video data decompression apparatus; 
60 FIGS. 3a and 3b schematically illustrate the generation of 
discrete cosine transform (DCT) coefficients from video data 
representing a block of pixels; 

FIG. 4 is a schematic diagram of a video data decom- 
pression apparatus according to an embodiment of the 
65 invention; 

FIG 5a schematically illustrates the operation of motion 
compensation in the DCT domain; 
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FIG. Sb schematically illustrates a desired DCT block present invention. In fact, FIG. 4 shows just one application 
overlying four existing DCT blocks; of the present technique, to illustrate the principles involved. 

FIGS. 6a to 6d schematically illustrate the generation of 0tner applications of these techniques will be described 
the desired DCT block from the four existing blocks; and below. 

FIG. 7 is a schematic diagram of an apparatus for gen- 5 Referring to FIG. 4, compressed video data is supplied 
crating the desired DCT block of FIG. 5. first 10 a decoder 40 (which may be identical to that used in 

FIG. 2) which operates in a complementary manner to the 
DESCRIPTION OF THE PREFERRED encoder 30 of FIG. 1. As described above, therefore, the 

EMBODIMENTS decoder 40 performs inverse entropy coding, inverse-length 

„^ « . , . _ . io coding and inverse quantisation to generate blocks of DCT 

FIG. 1 is a schematic diagram of a previously proposed coeffidents at its output 

video data compression apparatus. In FIG. 1, input TT * rr-i^> -i iL ui i 

z jv • * j . - i- j c . . *• However, in contrast to the apparatus of FIG. 2, the blocks 

(uncompressed) video data is supplied first to a motion r ~ «... j . 

estimator 10 which generates motto .vectors for each macro ??„ D( ? Ratals are supplied to a mot.on compensator 

block of a current field or frame indicating portions of a „ U0 P edonos ™°' 10n ^P^on on the DCT data, 

j i ril . - j_- l . 15 using techniques to be described below, 

preceding and/or following field or frame which most ' r „ . . , 
closely resemble that macro block. ¥in ^ thc motion-compensated DCT data is supplied to 



The differences between the current macro block and the 



an inverse DCT coder 50, which may be similar or identical 
to the inverse DCT coder of FIG. 2. 



portion of the reference field or frame(s) pointed to by the ™ . - A , 4 . . r . . H 

„ , . , . V ^. „ « . Ine ami or the new technique of motion compensation in / 

motion vectors are then encoded by the Discrete Cosme 20 * u ™^r/ ** 1 c \ 1 ■ • * *u > I 

r~ f sr\s*r\ ■ r\r^r j 1A r^r^r j the DCT (spatial frequency) domain is to use the DCT data 

Transform (DCT) in a DCT encoder 20. The DCT encoder . 4 . \f j . a* ± . ■ • « I 

20 generates an array or block of DCT coefficients from the ^ ?■ ! ?° Z Zr"^* ""^ * 

difference data associated with each macro block. generated by the motion estmiator 10 in FIG. lto genera e-/ 

for every 8x8 macro block of the eventual image — the blockf 
Finally, the blocks of DCT coefficients are supplied to an of 54 Dcr ^efficients which in the spatial frequency 

encoder 30 which quantises the DCT coefficients and then 25 domain 5est represents that macro block. Since a motion 
forms run-length and entropy (eg Huffman) coding to gen- vector ^ supp]ied for each macro block of the eventual 
erate a data stream of compressed video data. output it ^ thereforc necessary to project a set of 

FIG. 2 is a schematic diagram of a complementary DCT coefficients from a position in the DCT domain pointed 
previously proposed video data decompression apparatus to by the motion vector into each macro block for the 

which is operable to decompress the compressed video data 30 required output image. 

output by the apparatus of FIG. I. ^ process fa illustrated schematically in FIG. 5a. At the 

In FIG. 2, the compressed video data is supplied first to a left-hand side of FIG. 5a an array of blocks 90 of DCT data 
decoder 40 which operates in a complementary manner to output by the decoder 40 is illustrated. At the right-hand side 
the encoder 30 of FIG. I. Therefore, in particular, the of FIG. 5a, an array of blocks 90* of DCT data to be supplied 

decoder 40 performs inverse entropy coding, inverse run- 35 to the inverse DCT coder 50 is illustrated, 
length coding and inverse quantisation to generate blocks of p or eac h block 90* of the required DCT data, there is an 
DCT coefficients at its output associated motion vector 120. (In fact, strictly speaking, the 

These blocks of DCT coefficients are supplied to an motion vectors are associated with blocks of pixels, but it 

inverse DCT coder 50 which transforms the DCT coeffi- ^ has already been noted that there is a one-to-one correspon- 
dents into spatial video information. The output of the deoce between pixel blocks 70 and DCT blocks 90 (90*)). 
inverse DCT coder 50 represents the differences between the An area 140 illustrates the notional position of the] 
current macro block and a block of pixels of a reference required DCT block 130, as projected back into the available 
frame or frames pointed to by motion vectors associated blocks of DCT data 90. It will be seen that the notional I 

with the macro block. Therefore, a stage of motion com- 4S position 140 in fact overlaps four of the DCT b locks o utput { 
pensation 60 is required to obtain the block or blocks pointed by the deco^eT^OC^Ctecr inique will b ^TlesCriDeHTeTovrm| 
to by the motion vectors and combine them with the differ- which the required block 130 can be generated from the fourj 
ence data to generate output video data. existing overlapped blocks of DCT data. In fact, for each! 

FIGS. 3a and 36 schematically illustrate the generation of particular required block of DCT data, the coefficients of than 

discrete cosine transform (DCT) coefficients from video data 50 required block 130 are generated from of the array of DCT' 
representing a block of pixels. In particular, FIG. 3a shows blocks 90 output by the decoder 40, which is pointed to by 
a part of an image divided up into blocks 70 of 8x8 pixels tracing back along the respective motion vector 120 asso- 
80. (In other embodiments, different block sizes could of ciated with the required block 130. 
course be used). If the motion vectors always had motion components in 

The DCT process is well described elsewhere, and leads 55 the horizontal and vertical directions of multiples of 8 pixels, 
to blocks 90 of 8x8 DCT coefficients 100 being generated this motion compensation process would be extremely 
(FIG. 3b). Importantly, each block 90 of DCT coefficients simple since one of the DCT blocks 90 would map directly 
represents the spatial frequency content of a corresponding on to the required block 130. However, in practice motion 
respective block 70 of the original image. In other words, vectors can take any value (or at least more possible values 

there is a one-to-one mapping between image blocks 70 and go man merely multiples of 8 pixels) and so in general the 
DCT blocks 90. The DCT process is self-contained with notional area 140 will overlap at least two, and usually four, 
respect to the block structure, so that the coefficients of a DCT blocks 90. Further processing is therefore required to 
particular DCT block 90 are unaffected by pixels in blocks map the coefficients on to the required block 130. 
70 of the input image other than the particular block 70 FIG. 5b is an enlarged view of the area 140 of the 

corresponding to that block 90 of coefficients. 55 left-hand side of FIG. 5a. 

FIG. 4 is a schematic diagram of a video data decom- It will be seen that the area 140 in fact overlaps four of the 

pression apparatus according to an embodiment of the DCTblocks 90. In particular, the area 140 can be considered 
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as four sub-areas 141, 142, 143 and 144 overlapping respec- 
tive individual DCT blocks 90. 

A technique is therefore required that can compute the 64 
DCT coefficients of the desired block 130 from the DCT 
coefficients of the four sub-areas 141 . . . 144, without 
resorting to the complex and processor-intensive solution of 
transforming the four overlapped blocks 90 back into the 
pixel domain and then recoding the area 140. 

Given that the DCT process is block-based, with a one- 
to-one correspondence between blocks of pixels and corre- 
sponding blocks of DCT coefficients, the following obser- 
vations are made: 

(i) each of the four overlapped DCT blocks of FIG. Sb 
corresponds to a respective block of pixels in the pixel 
domain; and 

(ii) the required DCT block in fact represents a DCT 
transformation of a composite block of pixels made up 
of pixels in positions corresponding to the four sub- 
areas 141 . . . 144. 

Showing this in an illustrative matrix form, and using the 20 
distributive property of the DCT process, 
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suitable pre- and post-matrices. In other words, in the pixel 
domain, an example required matrix R can be generated as 
follows: 



10 



15 



0 0 0 0 
0 0 0 0 



X X X X X X 



X X X X X X 



X X X X X X 



X X X X X X 



X X X X X X 



X X X X X X 



(/?)= 



25 



30 



[pre-matnx) * 



(video matrix)* 



(post- matrix) 



35 



40 



45 



where an 'x* in each matrix on the right hand-side of this 
equation indicates a pixel value from a pixel sub-area 
corresponding to the sub-areas 141 . . . 144 (as translated to 
the required position in the required DCT array), and a '0 5 
simply represents a zero value. 

Each of the four matrices on the right hand side of the 
above equation can actually be generated from the respec- 
tive full block of pixels by pre- and post-multiplication by 



where the dot represents a matrix multiplication process 

and a *y* represents a pixel value. 
Applying the DCT process to both sides of this equation, 
each of the four DCT matrices on the right hand side of the 
first equation above can be written as a product of three 
matrices: 

DCT [R}-DCr [(pre-matrix)-(video matrix)-(pos (.-matrix)] 

As all non-zero elements of the pre-and post-matrices in 
this embodiment form identity sub-matrices (see below), 
this in fact can be re-written in a different form: 

DCT [RJ-DCT [(pre-matrix)]DCT [(video matrix)]- DCT [(post- 
matrix)] 

However, DCT [(video matrix)] is simply the block of 
DCT coefficients overlapped by the required sub-area 
141 .. . 144. 

50 This therefore shows that the DCT coefficients for the 
block R, i.e. DCT [R]. can be obtained by pre- and post- 
multiplication of each overlapped existing DCT block 90 by 
suitable frequency domain pre- and post-matrices. These 
frequency domain pre- and post-matrices are obtained by 

55 applying the DCT transform to pixel domain pre- and 
post-matrices which give block translations, as described 
below. 

The derivation of the pixel domain pre- and post-matrices 
is described in Appendix 1; the frequency-domain matrices 
60 are then obtained by applying the DCT process to the pixel 
domain matrices. 

FIGS. 6a to 6d schematically summarise the effect of the 
pixel domain translation pre- and post-matrices to translate 
portions 141 . . . 144 of four blocks of pixels to respective 
65 portions 131 . . . 134. 

It will be appreciated that the known rules of matrix 
multiplication (e.g. associativity for square matrices) can be 
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applied to vary the order of the multiplication steps 
described here. The particular described arrangement of pre- 
and post-matrices is by way of example only. 

FIG. 7 is a schematic diagram of an apparatus for per- 
forming the required matrix computation within the motion 5 
compensator HO. 

In FIG. 7, DCT blocks 90 from the decoder 40 arc stored 
in a DCT frame store 160. The motion vector for the current 
output block 130 is used to compute a DCT block number, 
representing the block in which the upper left-hand comer of 1Q 
the area 140 is disposed (in FIG. 5b, this would identify the 
block 91), together with an x offset and a y offset in pixels 
between 0 and 7 (blocksize-1) pixels. 

The block number, x offset and y offset are supplied to the 
DCT frame store, and the x offset and y offset values are 
supplied to a matrix generator 170. 15 

In response to the block number, blocks of coefficients 
from the DCT frame store are supplied to four matrix 
multipliers 180. The four blocks 90 which are supplied to 
respective matrix multipliers 180 are: the block in which the 
upper left-hand corner of the area 140 is disposed, the block 20 
immediately to the right of that block, the block immediately 
underneath that block, and the block immediately diagonally 
underneath and to the right of that block. In other words, the 
four blocks of FIG. 56 which overlap the required area 140 
are supplied to respective matrix multipliers 180. 25 

The matrix generator 170 generates frequency-domain 
pre- and post-matrices which are supplied to respective 
matrix multipliers 180. These matrices are generated in 
accordance with the rules given in Appendix 1, followed by 
application of the DCT transform to the pixel domain 30 
matrices produced by Appendix 1. Alternatively, the matrix 
generator 170 could simply access a look-up table in which 
matrix coefficients (previously generated by the above 
techniques) are stored for each permutation of the x and y 
onsets. 35 

Each matrix multiplier performs pre and post multiplica- 
tion by the respective matrices and supplies a matrix output 
to a matrix adder of 190. This performs matrix addition of 
the four outputs of the matrix multipliers 180 to generate the 
required output block 130. 40 

The question may arise that if the area 140 overlaps only 
one DCT block 90 held in the DCT firamestore 160, there is 
no need for four matrix multiplications and a subsequent 
addition. This is true, but since the remaining three sets of 
pre- and post-matrices (for the adjacent but no n -overlapped 45 
blocks) would have all zero coefficients using the rules of 
appendix 1, the matrix adder 190 would simply receive the 
required block 130 and three sets of zero matrices. It is 
therefore simpler not to distinguish the special case of a 
complete overlap of a single block 90, but to allow the 50 
matrix process to take care of this situation. 

Although the embodiments described above have inter- 
changed the order of motion compensation and DCT decod- 
ing but still produce output video from the DCT decoder, the 
techniques described above can be used for, application such 55 
as changing the GOP format of, for example, an MPEG- 
encoded video stream. For example, if it is desired to convert 
from a 12-frame GOP to a 2- frame GOP, some of the B or 
P frames of the 12-frame GOP must be converted to I 
frames, for some of the 2-frame GOPS. Since I frames do 60 
not make use of motion compensation with respect to other 
frames (they are intra-frame encoded), the motion compen- 
sation of the data must be "undone" . Previously, this would 
have been performed by transforming back to this basal 
domain and re-encoding; however, using the techniques 65 
presented here, the process can be performed in the DCT 
domain. 



Another use of the technique may be found in digital 
video effects as applied to DCT encoded data. If, for 
example, a picture is being cropped or expanded so that the 
new picture bound ary do es not on e up witn a Ijui b lock 
boundary, then previously tne DCi data wolild have hatTto 
Eavetjeen decoded so that this manipulation is performed in 
the spatial (pixel) domain. Now, using the techniques 
described above, new DCT blocks at the new boundary of 
the image can be generated in the DCT domain, so there is 
no need for the decoding-recoding process, 

Although illustrative embodiments of the invention have 
been described in detail herein with reference to the accom- 
panying drawings, it is to be understood that the invention 
is not limited to those precise embodiments, and that various 
changes and modifications can be effected therein by one 
skilled in the art without departing from the scope and spirit 
of the invention as defined by the appended claims. 

APPENDIX 1 

This appendix describes the generation of pixel domain 
translation matrices. The corresponding frequency domain 
pre- and post-matrices are generated by applying a DCT 
transformation to the pixel domain matrices. 

Considering first some definitions and statements which 
will assist in explanation of the rules, an identity matrix is 
a matrix in which all elements are zeroes except those 
elements on the leading diagonal. For example, a 2x2 
identity matrix is: 



and a 3x3 identity matrix is: 



(i 0 0 
0 1 0 
0 0 1 



A block of KxK pixesl is treated as a KxK matrix of 
elements. It is first pre-multiplied by a pre- matrix and is then 
post-multiplied by a post-matrix. This process is illustrated 
below: 



ra-t 



prc- 
matrix, 



matrix J 



A pre- or post-matrix in this context is a KxK square 
matrix which contains one identity sub-matrix of size lxl, 
where 1 is less than K. All other elements of the pre- or post 
matrix are zeroes. 

The rules for generating pre- and post-matrices are as 
follows: 

1. Generate the non-zero elements of the post-matrix as an 
identity sub-matrix of size mxm, where m is equal to the 
number of columns in the required notional block that 
contain non-zero elements. 

2. Generate the non-zero elements of the pre-matrix as an 
identity sub-matrix of size nxn, where n is equal to the 
number of rows in the required notional block that contain 
non-zero elements. 

3. For the post-matrix, move identity sub-matrix down by x 
rows if it is required to move the columns of the notional 
block leftwards by x columns. 

4. For the post-matrix, move identity sub-matrix right by x 
columns if it is required to move the columns of the notional 
block rightwards by x columns. 
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5. For the pre-matrix, move identity sub-matrix down by x 
rows if it is required to move the rows of the notional block 
down by x rows. 

6. For the pre-matrix, move identity sub-matrix right by x 
columns if it is required to move the rows of the notional 
block up by x rows. 



10 

and aiming for the final matrix 



0 e 

0 i 

0 m 

0 0 



EXAMPLE 1 

In this and the following example, 4x4 matrices (i.e. K«4) 
will be used for ease of explanation, even though in many 
DCT-based systems larger block sizes are commonly used. 
The principles remain the same, however, whatever the 
value of K. 



The initial pixel block is therefore: 



(1) 



the required pre-matrix is 



10 



15 



20 



fO 0 1 

0 0 0 

0 0 0 

0 0 0 



and the required post-matrix is 



0\ 



and the final (desired) matrix is: 



25 



(0 0 0 0\ a) 

c d 0 0 

g h 0 0 

k I 0 0 



30 



The pre- and post matrices are determined as follows: 

a) For the pre-matrix, the required identity sub-matrix is 
a 3x3 sub-matrix. It then has to move down by 1 row 
in order to move the rows of the initial matrix down by 
1 row. The pre-matrix is therefore: 



35 



(0 o o 
10 0 0 
0 10 0 
0 0 10 



40 



b) For the post-matrix, the required identity sub-matrix is 
a 2x2 sub-matrix. It then has to move left by 2 columns 
in order to move the rows of the initial matrix down by 
2 rows. The post-matrix is therefore: 



0 0 0 0 
0 0 0 0 
10 0 0 

o t o o; 



EXAMPLE 2 
Starting with the same initial matrix, 



(abed 

' f g h 
i j k l 
m n o p 



45 



50 



55 



60 



65 



I claim: 

1. A method of processing a number of input arrays of 
image spatial frequency coefficients being transformable to 
image pixel values by a predetermined spatial frequency 
transformation, said method comprising the steps of: 

generating an output array of image spatial frequency 
coefficients from said number of input arrays; 

detecting which of said number of input arrays contain 
portions overlapped by said generated output array; 

generating at least one pixel domain translation matrix 
corresponding to each of said number of input arrays 
which contain portions overlapped by said generated 
output array; 

matrix-multiplying each pixel domain translation matrix 
the corresponding input array subjected to the inverse 
of said predetermined spatial frequency transformation, 
so that said means for matrix-multiplying provides a 
translation of the respective overlapped portion to an 
overlapping position in said output array; 

matrix-multiplying each of said number of input arrays by 
the respective one of the pixel domain translation 
matrices subjected to the inverse of said predetermined 
spatial frequency transformation; and 

matrix-adding the matrix-multiplied image spatial fre- 
quency coefficients generated from each of said number 
of input arrays; 

means for outputting the results of said matrix-adding 
step. 

2. A method according to claim 1, wherein said predeter- 
mined spatial frequency transformation is the inverse dis- 
crete cosine transform. 

3. A method according to claim 1, wherein the step of 
detecting portions of said input arrays overlapped by said 
output array is in response to a motion vector associated with 
said output array. 

4. A method according to claim 1, wherein the pixel 
domain matrices comprise a p re-multiplying matrix and a 
post- multiplying matrix. 

5. Video signal processing apparatus for processing a 
number of input arrays of image spatial frequency coeffi- 
cients being transformable to image pixel values by a 
predetermined spatial frequency transformation, said appa- 
ratus comprising: 
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means for generating an output array of image spatial 
frequency coefficients from said number of input 
arrays; 

means for detecting which of said number of input arrays 
contain portions overlapped by said generated output 5 
array; 

means for generating at least one pixel domain translation 
matrix corresponding to each of said number of input 
arrays which contain portions overlapped by said gen- 
erated output array; 10 

means for matrix-multiplying each pixel domain transla- 
tion matrix the corresponding input array subjected to 
the inverse of said predetermined spatial frequency 
transformation, so that said means for matrix- 
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multiplying provides a translation of the respective 
overlapped portion to an overlapping position in said 
output array; 

means for matrix-multiplying each of said number of 
input arrays by the respective one of the pixel domain 
translation matrices subjected to the inverse of said 
predetermined spatial frequency transformation; and 
means for matrix-adding the matrix-multiplied image 
spatial frequency coefficients generated from each of 
said number of input arrays; 
means for outputting the results of said matrix-adding 
means. 

+ * * + * 
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